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General Achievement Trends — California 

K-12 enrollment — 6,275,469 



The raw data used to develop these state profiles, including data for additionai grade ievels and years before 2002, can be found 
on the CEP Web site at www.cep-dc.org . Click on the link on the ieft for No Chiid Left Behind. In the Document Library, look for 
the most recent report on student achievement since 2002. Below the name of the report, click on the link for View State Profiles 
and Worksheets. Scroll down the page, and click on the Worksheet links for any state. 



Overall Achievement — Key Findings 

General results 

The tables in this profile present state test results in reading and math at three achievement levels (basic, proficient, and advanced) and at one 
grade each at the elementary, middle, and high school levels. These data are more complete than the percentage of students scoring proficient 
that is the main indicator used to determine adequate yearly progress under the No Child Left Behind Act. 

Overall, California students have made gains since 2004 at the basic, proficient, and advanced achievement levels. 

Specific results 

• The percentage of students scoring at the basic level and above in reading increased at a moderate-to-large rate at the elementary and 
high school grades analyzed and at a slight rate at the middle school level. In math, the percentage basic and above rose slightly at the 
elementary and middle school grades analyzed and grew at a moderate-to-large rate at the high school level. 

• In reading, the percentage of students performing at the proficient level and above went up at a moderate-to-large rate at the elementary 
and middle school levels and at a slight rate at the high school grade analyzed. In math, there were moderate-to-large gains in the 
percentage proficient at all three grade levels analyzed. 

• The percentage of students reaching the advanced level in reading increased at a moderate-to-large rate at the elementary and middle 
school grades analyzed but decreased slightly at the high school level. In math, the percentage of advanced students rose at a moderate- 
to-large rate at all three grade levels analyzed. 
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Data Limitations 

Years of comparable percentage proficient data 2004 through 2008 

Years of data needed to compute effect sizes 2004 through 2008 

Disaggregated data for aii subgroups and comparison groups Effect size data for grade 1 0 not avaiiabie for student subgroups untii 

2008. Effect size data for Aigebra I (middie schooi math) not 
avaiiabie for student subgroups untii 2007. 

Effect size data for grade 3-8 students who are not iow-income or 
Engiish ianguage iearners (ELLs) not avaiiabie untii 2007, so the 
subgroups of iow-income students and ELLs are compared with 
aii tested students in the state 

Percentage proficient data not avaiiabie for students who are not iow- 
income untii 2006. 

Percentage proficient data for students who are nof Engiish ianguage 
iearners (ELLs) not avaiiabie untii 2008, so the subgroup of 
ELLs is compared with aii tested students in the state 



Test Characteristics 

The characteristics highiighted beiow are for the state reading and mathematics tests used for accountabiiity under the No Chiid Left Behind Act 
(NCLB). 



Test(s) used for NCLB accountabiiity 



Grades tested for NCLB accountabiiity 
State iabeis for achievement ieveis 



Caiifornia Standards Tests (CSTs): 

Caiifornia Engiish-Language Arts Standard Test, grades 2-8, 
inciuding writing assessment at grades 4 and 7 
Caiifornia Mathematics Standard Test, grades 2-7 
Grade 8 course-specific tests: Generai Mathematics, Aigebra I, 
Geometry, Aigebra II, and Integrated Mathematics 1 , 2, or 3 

Caiifornia Aiternate Performance Assessment (CAPA) 

Caiifornia High Schooi Exit Examination (CAHSEE) 

CST grades 2-8, CAHSEE grade 10 

CA uses five achievement ieveis: Far Beiow Basic, Beiow Basic, 
Basic, Proficient, and Advanced. For our anaiyses we treated 
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High school NCLB test also used as an exit exam? 

First year test used 

Time of test administration 

Major changes in testing system (2002-present) 



Comments 



Below Basic + Basic as Basic, Proficient as Proficient, and 
Advanced as Advanced. 

Yes 

2004 

Spring 

2003: CST revised to target only CA content standards 
2006: New science tests added for grades 8 and 1 0 
2008: CSTs: expanded to include testing in ELA in grades 2-1 1 ; math 
in grades 2-9; science in grades 5, 8, and 10; and history/social 
science in grades 8 and 1 1 

Although the Algebra I end-of-course tests are used to determine 
achievement trends in grade 8 math, as the state recommended, 
students may take various math tests in grade 8. Approximately half 
of these students take the Algebra I test. 

CEP’s 2008 report on achievement included trends for elementary and 
middle school beginning in 2003 and for high school beginning in 
2004, however, the state has since indicated that 2004 is the most 
appropriate year for all tested grade levels. For that reason, all 
trends displayed below begin with 2004. 
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Overall Achievement — Percentages Proficient 

Figure CA-1. Percentage of Students Scoring at the Proficient Levei and Above in Reading 
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Table CA-1 . Percentage of Students Scoring at the Proficient Level and Above in Reading 



Reporting Year Pre-NCLB Post-NCLB 

Grade Average Yearly Average Yearly 



Level 


1999 


2000 


2001 


2002 


2003 


2004 


2005 


2006 


2007 


2008 


Percentage Point Gain 
1999-2002^ 


Percentage Point Gain 
2002-2008^ 


Grade 3 












30% 


31% 


36% 


37% 


38% 


NA 


2.0 


Grade 4 












39% 


47% 


49% 


51% 


55% 


NA 


4.0 


Grade 5 












40% 


43% 


43% 


44% 


48% 


NA 


2.0 


Grade 6 












36% 


38% 


41% 


42% 


47% 


NA 


2.8 


Grade 7 












36% 


43% 


43% 


46% 


49% 


NA 


3.3 


Grade 8 












33% 


39% 


41% 


41% 


45% 


NA 


3.0 


Grade 10 












49% 


48% 


50% 


48% 


52% 


NA 


0.8 



Table reads: The percentage of 3'^'* graders who scored at the proficient level and above on the state reading test increased from 30% in 2004 to 38% in 2008. The 
average yearly gain in the percentage proficient in grade 3 reading was 2.0 percentage points per year after NCLB was enacted. 

^Averages are subject to rounding error. 
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Figure CA-2. Percentage of Students Scoring at the Proficient Levei and Above in Mathematics 
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Table CA-2. Percentage of Students Scoring at the Proficient Level and Above in Mathematics 



Reporting Year Pre-NCLB Post-NCLB 

Grade Average Yearly Average Yearly 



Level 


1999 


2000 


2001 


2002 


2003 


2004 


2005 


2006 


2007 


2008 


Percentage Point Gain 
1999-2002^ 


Percentage Point Gain 
2002-2008^ 


Grade 3 












48% 


54% 


58% 


58% 


61% 


NA 


3.3 


Grade 4 












45% 


50% 


54% 


56% 


61% 


NA 


4.0 


Grade 5 












38% 


44% 


48% 


49% 


51% 


NA 


3.3 


Grade 6 












35% 


40% 


41% 


42% 


44% 


NA 


2.3 


Grade 7 












33% 


37% 


41% 


39% 


41% 


NA 


2.0 


Algebra 1 












35% 


34% 


40% 


38% 


42% 


NA 


1.8 


Grade 10 












45% 


45% 


47% 


49% 


52% 


NA 


1.7 



Table reads: The percentage of 3'^'* graders who scored at the proficient level and above on the state math test increased from 48% in 2004 to 61% in 2008. The 
average yearly gain in the percentage proficient in grade 3 math was 3.3 percentage points per year after NCLB was enacted. 

^Averages are subject to rounding error. 
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Overall Achievement — Percentages Advanced, Proficient, and Basic 

How to read figures 3 and 4 and tables 3 and 4 

The stacked bars in figures 3 and 4 show the percentages of students scoring at the basic, proficient, and advanced ieveis on the state tests used 
for NCLB accountabiiity. The foiiowing information may be heipfui in interpreting the figures: 

• The percentage proficient and above — the benchmark used to determine adequate yeariy progress under NCLB — is the sum of the middie 
and top segments of the bars (percentage proficient pius percentage advanced). 

• The percentage basic and above is the sum of aii three segments of the bars (percentage basic pius percentage proficient pius 
percentage advanced). 

• The sums that resuit from adding the segments of the bars in these ways correspond with the percentages proficient and above, and basic 
and above, shown in tabies 3 and 4. In a few instances, however, the sums in the figures may differ from those in the tabies by a 
percentage point due to rounding. 

• The bars do not totai 100% because students who score below the basic ievei are not dispiayed. 

• By iooking at the percentages in each segment of the bars, one can see how achievement trends at the three ieveis interact. Ideaiiy, one 
wouid want to see increases at aii three ieveis, as more students move from beiow basic to basic achievement, from basic to proficient, 
and from proficient to advanced. But other scenarios may aiso be iiiuminating. For exampie, gains may occur in the percentage basic even 
if the percentage proficient and above has stayed the same, suggesting that progress has been made in moving students from the beiow 
basic to the basic ievei. Or, if the percentage proficient has grown whiie the percentages basic and advanced have shrunk, this suggests 
that educators may have focused a great deai of attention on moving students from the basic to proficient ieveis. 

• Some states use different iabeis for their achievement ieveis instead of basic, proficient, and advanced. The specific state iabeis are iisted 
in the Test Characteristics section at the beginning of this profiie. 




2009 



GENERAL ACHIEVEMENT TRENDS — CALIFORNIA 



9 



Figure CA-3. Percentages of Students Scoring at the Advanced, Proficient, and Basic Leveis in Reading 
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Table CA-3. Percentages of Students Scoring at the Advanced, Proficient and Above, and Basic and Above Levels in Reading 









Reporting Year 








Average Yearly 
Percentage Point Galn^ 


Achievement Level 


2002 


2003 


2004 


2005 


2006 


2007 


2008 


Grade 4 


Advanced 






16% 


20% 


24% 


25% 


28% 


3.0 


Proficient and Above 






39% 


47% 


49% 


51% 


55% 


4.0 


Basic and Above 






91% 


91% 


90% 


92% 


95% 


1.0 


Grade 8 


Advanced 






11% 


15% 


18% 


16% 


18% 


1.8 


Proficient and Above 






33% 


39% 


41% 


41% 


45% 


3.0 


Basic and Above 






88% 


90% 


90% 


88% 


89% 


0.3 


Grade 1 0 


Advanced 






27% 


27% 


29% 


24% 


26% 


-0.2 


Proficient and Above 






49% 


48% 


50% 


48% 


52% 


0.8 


Basic and Above 






74% 


76% 


77% 


77% 


79% 


1.3 



Table reads: The percentage of 4*^ graders who scored at the advanced level on their state reading test increased from 1 6% in 2004 to 28% in 2008. During this 
period, the average yearly gain in the percentage advanced was 3.0 percentage points per year in grade 4 reading. 

^Averages are subject to rounding error. 
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Figure CA-4. Percentages of Students Scoring at the Advanced, Proficient, and Basic Leveis in Mathematics 
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Table CA-4. Percentages of Students Scoring at the Advanced, Proficient and Above, and Basic and Above Levels in Mathematics 









Reporting Year 








Average Yearly 
Percentage Point Galn^ 


Achievement Level 


2002 


2003 


2004 


2005 


2006 


2007 


2008 


Grade 4 


Advanced 






18% 


26% 


29% 


30% 


32% 


3.5 


Proficient and Above 






45% 


50% 


54% 


56% 


61% 


4.0 


Basic and Above 






97% 


94% 


96% 


95% 


98% 


0.3 


Algebra 1 


Advanced 






8% 


8% 


12% 


9% 


13% 


1.3 


Proficient and Above 






35% 


34% 


40% 


38% 


42% 


1.8 


Basic and Above 






92% 


90% 


89% 


90% 


93% 


0.3 


Grade 1 0 


Advanced 






14% 


14% 


16% 


16% 


19% 


1.3 


Proficient and Above 






45% 


45% 


47% 


49% 


52% 


1.7 


Basic and Above 






74% 


74% 


76% 


75% 


79% 


1.2 



Table reads: The percentage of 4*^ graders who scored at the advanced level on their state math test increased from 18% in 2004 to 32% in 2008. During this 
period, the average yearly gain in the percentage advanced was 3.5 percentage points per year in grade 4 math. 

^Averages are subject to rounding error. 
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Overall Achievement — Effect Sizes 

How to read figures 5 and 6 and tables 5 and 6 

An effect size is a statistical tool that conveys the amount of difference between test results using a common unit of measurement which does not 
depend on the scoring scale for a particular test. An effect size is computed by subtracting the mean scale score (the average score) on a test for 
one year, such as 2006, from the mean scale score for another year, such as 2007, then dividing the result by the average standard deviation. 
(The standard deviation is a measure of how much test scores tend to deviate from the mean — in other words, how spread out or bunched 
together scores are.) If the mean score has not changed, then the effect size is 0. An effect size of +1 indicates an increase of 1 standard 
deviation from the previous year’s mean score. Effect sizes can also be used to calculate differences in scores between two subgroups of 
students. 

Tables 5 and 6 show mean scale scores, standard deviations, and the accumulated annual effect size (AAES), which is the cumulative gain in 
effect size over a range of years. For example, to determine the accumulated annual effect size between 2006 and 2008, one would calculate the 
change in effect size from 2006 to 2007, and from 2007 to 2008, then add the results together. In figures and tables 5 and 6, 2002 (or the closest 
year with comparable data) was used as a starting point (0.00) to calculate accumulated annual effect sizes after NCLB was enacted (and before, 
if available). Steady gains in AAES are represented by negative numbers before 2002 rising to positive numbers after 2002, so that pre- and post- 
NCLB trends can be shown on the same trend line. A positive AAES before 2002 or a negative AAES after 2002 indicates a decline in 
performance over time. 




Accumulated Annual Effect Sizes 



2009 



GENERAL ACHIEVEMENT TRENDS — CALIFORNIA 



14 



Figure CA-5. Reading Achievement Trends in Terms of Effect Sizes 
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Table CA-5. Reading Achievement Trends in Terms of Effect Sizes 



Grade 

Level 












Reporting Year 










Pre-NCLB 

Average 


Post-NCLB 

Average 




1999 


2000 


2001 


2002 


2003 


2004 


2005 


2006 


2007 


2008 


Yearly Effect 
Size Gain 
1999-2002^ 


Yearly Effect 
Size Gain 
2002-2008^ 


Grade 4 


MSS 

(SD) 












338.5 

(52) 


346.2 

(54) 


350.9 

(59) 


353.1 

(57.5) 


357.7 

(55.8) 








AAES 












0.00 


0.15 


0.23 


0.27 


0.35 


NA 


0.09 


Grade 8 


MSS 

(SD) 












328.1 

(52) 


334.4 

(55) 


339.2 

(56) 


338.7 

(67.8) 


341.2 

(58.1) 






AAES 












0.00 


0.12 


0.20 


0.20 


0.24 


NA 


0.06 


Grade 1 0 


MSS 

(SD) 












376 

(39) 


377 

(38) 


378 

(39) 


376 

(38) 


379.7 

(37.5) 






AAES 












0.00 


0.03 


0.05 


0.00 


0.10 


NA 


0.02 



Table reads: The mean scale score (MSS) ef 4*^ graders on the state reading test increased from 338.5 in 2004 to 357.7 in 2008. The standard deviatien (SD) for 
the mean scale score In 2004 was 52. Using 2004 as a starting point (0.00), the accumulated annual effect size (AAES) for grade 4 reading totaled 0.35 by 2008. 
For the post-NCLB period, the average yearly gain In effect size at grade 4 was 0.09. 

Note: The CST (grades 4 and 8) Is scored on a scale of 150-600; the CAHSEE (grade 10) is scored on a scale of 275-450. 

^Averages are subject to rounding error. 






Accumulated Annual Effect Sizes 
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Figure CA-6. Mathematics Achievement Trends in Terms of Effect Sizes 
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Table CA-6. Mathematics Achievement Trends in Terms of Effect Sizes 



Grade 

Level 












Reporting Year 










Pre-NCLB 

Average 


Post-NCLB 

Average 




1999 


2000 


2001 


2002 


2003 


2004 


2005 


2006 


2007 


2008 


Yearly Effect 
Size Gain 
1999-2002^ 


Yearly Effect 
Size Gain 
2002-2008^ 


Grade 4 


MSS 

(SD) 












343.2 

(64) 


354 

(70) 


361.4 

(74) 


366.1 

(73.5) 


373.9 

(74.9) 






AAES 












0.00 


0.16 


0.26 


0.33 


0.43 


NA 


0.11 


Algebra I 


MSS 

(SD) 












330.8 

(65) 


330.4 

(66) 


338.5 

(74) 


336.8 

(68) 


342.9 

(73.7) 






AAES 












0.00 


-0.01 


0.11 


0.09 


0.17 


NA 


0.04 


Grade 1 0 


MSS 

(SD) 












377 

(38) 


376 

(38) 


378 

(38) 


380 

(40) 


382.8 

(39.1) 






AAES 












0.00 


-0.03 


0.03 


0.08 


0.15 


NA 


0.04 



Table reads: The mean scale score (MSS) of 4*^ graders on the state math test Increased from 343.2 In 2004 to 373.9 In 2008. The standard deviation (SD) for the 
mean scale score In 2004 was 64. Using 2004 as a starting point (0.00), the accumulated annual effect size (AAES) for grade 4 math totaled 0.43 by 2008. For the 
post-NCLB period, the average yearly gain in effect size at grade 4 was 0.1 1 . 

Note: The CST (grades 4 and Algebra I) is scored on a scale of 1 50-600; the CAHSEE (grade 1 0) Is scored on a scale of 275-450. 

^Averages are subject to rounding error. 
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Key Terms 

Percentage proficient (and above) — The percentage of students in a group who score at and above the cut score for “proficient” performance on 
the state test used to determine progress under NCLB. The Act requires states to report student test performance in terms of at ieast three 
achievement ieveis: basic, proficient, and advanced. Adequate yeariy progress determinations are based on the percentage of students scoring at 
the proficient ievei and above. 

Percentage basic (and above) — The percentage of students in a group who score at and above the cut score for “basic” performance on the 
state test used to determine progress under NCLB. 

Percentage advanced — The percentage of students in a group who reach or exceed the cut score for “advanced” performance on the state test 
used to determine progress under NCLB. 

Moderate-to-iarge gain — For the percentage basic, proficient, or advanced, an average gain of 1 or more percentage points per year. For effect 
size, an average gain of 0.02 or greater per year. 

Siight gain — For the percentage basic, proficient, or advanced, an average gain of iess than 1 percentage point per year. For effect size, an 
average gain of iess than 0.02 per year. 

Moderate-to-iarge deciine — For the percentage basic, proficient, or advanced, an average deciine of 1 or more percentage points per year. For 
effect size, an average deciine of 0.02 or greater per year. 

Siight deciine — For the percentage basic, proficient, or advanced, an average deciine of iess than 1 percentage points per year. For effect size, 
an average deciine of iess than 0.02 per year. 

Effect size — A statisticai tooi that conveys the amount of difference between test resuits using a common unit of measurement which does not 
depend on the scoring scaie for a particuiar test. 

Accumuiated annuai effect size — The cumuiative gain in effect size over a range of years. 

Mean scaie score — The arithmeticai average of a group of test scores, expressed on a common scaie for a particuiar state’s test. The mean is 
caicuiated by adding the scores and dividing the sum by the number of scores. 

Standard deviation — A measure of how much test scores tend to deviate from the mean — in other words, how spread out or bunched together 
test scores are. If students’ scores are bunched together, with many scores dose to the mean, then the standard deviation wiii be smaii. If scores 
are spread out, with many students scoring at the high or iow ends of the scaie, then the standard deviation wiii be iarge. 
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Cautions and Explanations 

Different labels for achievement levels — For consistency, all of the state profiles developed for this report use a common set of labels (basic, 
proficient, and advanced) for the main achievement levels required by NCLB. In practice, however, some states may use different labels, such as 
“meets standard” instead of proficient, and some states have established additional achievement levels beyond those required by NCLB. 

Different names for subgroups — For the sake of consistency and ease of data tabulation, all of the state profiles developed for this report use a 
common set of names for the major student subgroups. In practice, however, states use various names for subgroups that may differ from those 
used here (such as using “Hispanic” instead of “Latino,” or “special education students” instead of “students with disabilities”). Moreover, a few 
states separately track the performance of subgroups not included in the analyses for this report. 

Special caution for students with disabilities and English language learners — Trends for students with disabilities and English language learners 
should be interpreted with caution because changes in federal guidance and state accountability plans may have altered which students in these 
subgroups are tested for accountability purposes, how they are tested, and when their test scores are counted as proficient under NCLB. These 
factors could affect the year-to-year comparability of test results. 

Inclusion of former English language learners — In many states, the subgroup of English language learners (also known as limited English 
proficient students) includes students who were formerly English language learners but who have achieved English language proficiency or 
fluency in the last two years. Federal NCLB regulations permit states to include these formerly ELL students (sometimes referred to as 
“redesignated fluent English proficient” students) in the ELL subgroup for up to two years for purposes of NCLB accountability. 

Limitations of percentage proficient measure — The percentage proficient, the main gauge of student performance under NCLB, can be easily 
understood and gives a snapshot of how many students have met their state’s performance expectations. But it also has several limitations as a 
measure of student achievement. Users of percentage proficient data should keep in mind these limitations, particularly the following: 

* “Proficient” means different things across different states. States vary widely in curriculum, learning expectations, and tests, and state tests differ 
considerably in their difficulty and cut scores for proficient performance. 

* Although this study has taken steps to avoid comparing test data where there have been “breaks” in comparability resulting from new tests, 
changes in content standards, revised cut scores, or other major changes in testing programs, the year-to-year comparability of test results in 
the same state may still be affected by less obvious policy and demographic changes. 

* Changes in student performance may occur that are not reflected in percentage proficient data, such as an increase in the number of students 
reaching performance levels below and above proficient (such as the basic or advanced levels). 

* The size of the achievement gaps between various subgroups depends in part on where a state sets its cut score for proficiency. For example, if 
a proficiency cut score is set so high that almost nobody reaches it or so low that almost everyone reaches it, there will be little apparent 
achievement gap. By contrast, if the cut score is closer to the mean test score, the gaps between subgroups will be more apparent. 

Difficulty of attributing causes — Although the tables above show trends in test scores since the enactment of NCLB, one cannot assume that 
these trends have occurred because of NCLB. It is always difficult to determine a cause-and-effect relationship between test score trends and any 
specific education policy or program due to the many federal, state, and local reforms undertaken in recent years and due to the lack of an 
appropriate “control” group of students not affected by NCLB. 





